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Abstract. Let G be the Lie group R 2 k R + endowed with the Riemannian symmetric 
space structure. Let Xo, X\, X2 be a distinguished basis of left-invariant vector fields of the 
Lie algebra of G and define the Laplacian A = — (Xq + X 2 + X 2 ). In this paper we consider 
the first order Riesz transforms Ri = Xi A -1 / 2 and Si — Ar x l 2 Xi, for i = 0, 1, 2. We prove 
that the operators Ri, but not the Si, are bounded from the Hardy space H 1 to L 1 . We 
also show that the second-order Riesz transforms TJy = Xi/S.~ 1 Xj are bounded from H 1 to 
L 1 , while the Riesz transforms Sy = A~ 1 XiXj and Rij = XiXjA^ 1 , for i,j = 0, 1,2, are 
not. 

1. Introduction 
Let G be the Lie group M 2 x M + where the product rule is the following: 

(xi, x 2 , a) ■ (x[, x' 2 , a') = (xi + a x\, x 2 + ax' 2 , a a') 

for (xi,X2,a), (x'^x^a!) G G. The group G is not unimodular; the right and left Haar 
measures are given by 

dp(xi, X2, a) = a" 1 dxi dx 2 da and d\(x\, X2, a) = a -3 dxi dx 2 da , 

respectively. The modular function is thus 5(x%, x 2 , a) = a" 2 . Throughout this paper, unless 
explicitly stated, we consider the right measure p on G and we denote by L p , \\ ■ \\ p and (•, •) 
the L p -space, the L p -norm and the L 2 -scalar product with respect to the measure p. 

The group G has a Riemannian symmetric space structure, and the corresponding metric, 
which we denote by d, is that of the three-dimensional hyperbolic half-space. The metric d 
is invariant under left translation and it is given by 

a ~\~ a~^ ~\~ a~~^~(x 2 ~\~ x 2 ) 
(1.1) coshr(xi, x 2 , a) = — V(xi, x 2 , a) E G , 
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where r(xi,x 2 , a) = d((x%, x 2 > a), e) denotes the distance of the point ( ) from the 

identity e = (0,0,1) of G. It is easy to verify that if r(xi,X2,a) < 1, then r(xi,x 2 ,a) ~ 
\(xi, X21 log a) |, where | ■ | denotes the euclidean norm in R 3 . The measure of a hyperbolic 
ball B r , centered at the identity and of radius r, behaves like 

{r 3 if r < 1 
e 2r if r > 1 . 

Thus G is a group of exponential growth. In this context, the classical Calderon-Zygmund 
theory and the classical definition of the atomic Hardy space H l (see |CWt l5t]) do not apply. 
Recently W. Hebisch and T. Steger |HS] constructed a new Calderon-Zygmund theory which 
holds in some spaces of exponential growth, in particular in the space (G, d, p) defined above. 
The main idea is to replace the family of balls which is used in the classical Calderon- 
Zygmund theory by a suitable family of parallelepipeds which we call Calderon-Zygmund 
sets. The definition appears in [HS] and implicitly in [GSj . and reads as follows. 

Definition 1.1. A Calderon-Zygmund set is a parallelepiped R = [bi — L/2, bi + L/2] x [6 2 — 
L/2, 6 2 + L/2] x [ae~ r , ae r ], where L > 0, r > and a G 1R + are related by 

e 2 ar < L < e 8 ar if r < 1 , 

ae 2r <L<ae 8r if r > 1 . 

We let TZ denote the family of all Calderon-Zygmund sets, and observe that 1Z is invariant 
under left translation. Given R G 71, we define its dilated set as R* = {x G G : d(x, R) < r}. 
There exists a constant C such that p(R*) < C p(R) and R C B((bi, 6 2 , a), C r) . 

In |HS] it is proved that every integrable function on G admits a Calderon-Zygmund 
decomposition involving the family TZ, and that a new Calderon-Zygmund theory can be 
developed in this context. By using the Calderon-Zygmund sets, it is natural to introduce 
an atomic Hardy space H l on the group G, as follows (see [V] for details). 

We define an atom clS db function a in L such that 

(i) a is supported in a Calderon-Zygmund set R] 

(ii) Halloo < p{R)~ l ; 

(iii) f a dp = . 

The atomic Hardy space is now defined in a standard way. 
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Definition 1.2. The Hardy space H 1 is the space of all functions f in L 1 which can be written 
as f = ^2 j Xj aj, where aj are atoms and Xj are complex numbers such that < 00 ■ 

We denote by the infimum ofj^j l<\jl over suc ^ decompositions. 

The new Calderon-Zygmund theory introduced in II IS is used to study the boundedness of 
some singular integral operators related to a distinguished Laplacian on G, which is defined 
as follows. 

Let Xq, Xi, X2 denote the left-invariant vector fields 

X = a d a X 1 = a d Xl X 2 = a d X2 , 

which span the Lie algebra g of G. The Laplacian A = — (Xq + X 2 + Xf ) is a left-invariant 
operator which is essentially selfadjoint on L 2 (p). Since A is positive definite and one-to-one 
GQSJ, its powers A", ael, have dense domains and are selfadjoint. This makes it possible 
to form the Riesz transforms of the first order associated with A, defined by 

(1.2) ^ = X 4 A- 1/2 and S { = A~ 1/2 X i} i = 0,1,2, 
and the Riesz transforms of the second order, defined by 

(1.3) Rij = XiXj A' 1 and S lj = A" 1 X { Xj and T tj = X l A' 1 X j , 

for i,j = 0, 1,2. The boundedness properties of the Riesz transforms associated with the 
distinguished Laplacian A defined above have been considered by many authors. Actually, 
some results in the literature concern the Riesz transforms associated with a distinguished 
right-invariant Laplacian A r , which is naturally related to A as follows. Let X\, i — 0,1, 2, 
be the right-invariant vector fields on G which agree with Xj at the identity, i.e., 

Xq = x\ d Xl + £2 d X2 + a d a X[ = d Xl X r 2 = d X2 . 

It is well known that Xtf = (X/) v for any / e C°°{G), where f(x) = fix' 1 ) for x e G. The 
Laplacian A r = — (Xq) 2 — (X[) 2 — (X£) 2 is a right-invariant operator which is essentially 
selfadjoint on L 2 (X). We denote by Rl, Sl,R r ^, S^, T[j the Riesz transforms defined as 
above by using the right-invariant vector fields and the right-invariant Laplacian instead of 
the left- invariant ones. It is easy to see that for any / G C%°(G), A r f = (A/) v , 

Rlf = (Rjy , s r j = (sjy 

and 

Ry = (Rijy , sy = (s t jy , ry = a\,f) . 
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Since / — > f is an isometry between I^(A) and L p (p) for p e [1, oo], results concerning the 
boundedness of the right-invariant Riesz transforms with respect to the left Haar measure A 
may be reformulated in terms of the left-invariant Riesz transforms with respect to the right 
Haar measure p. We now summarize some results formulated in terms of the left-invariant 
Riesz transforms defined by (jl.2p and (11.31) . 

In |GS2| [S] G. Gaudry and P. Sjogren studied Riesz transforms of the type XA" 1 ' 2 and 
A _1 / 2 X, where A is a distinguished Laplacian and X is a distinguished vector field, in the 
context of the group R x R + , also known as affine group of the real line. They proved that 
these operators are of weak type 1 and bounded on LP , for 1 < p < oo. In the sequel we 
sometimes refer to their papers: even if their setting is different, their arguments may be 
applied also to our context with some slight changes, and so their results carry over. 

Hebisch and Steger then proved that all the operators Ri are of weak type 1 and bounded 
on LP when 1 < p < 2 [HS, Theorem 6.4]. This result was obtained as an application of the 
Calderon-Zygmund theory on the group G. 

The operators Si are bounded on L 2 , for i = 0, 1, 2. For % ^ the operators Si are of weak 
type 1 and bounded on LP when 1 < p < 2, while the operator So is not of weak type 1 but 
bounded on LP for 1 < p < 2 (Hebisch, private communication). 

Since Ri and Si are bounded on LP for p < 2, it follows by duality that Ri and Si are also 
bounded on LP when 2 < p < oo. 

The second-order Riesz transforms have been studied first in |GQS| in the context of the 
affine group of the real line, then in |GS1] in the general setting of NA groups of rank 1, 
including the group G. The operators T^- are of weak type 1 and bounded on LP when 
1 < p < oo. The operators Rij and are not of weak type p, for any 1 < p < oo. 

In this paper we study the LL 1 — L 1 boundedness of the Riesz transforms on the group G. 
Our main results are the following: 

(1) the operators Ri, i — 0,1, 2, are bounded from LL 1 to L 1 (Section EJ); 

(2) the operators Si, i = 0,1, 2, are not bounded from LL 1 to L 1 (Sections HJ EJ); 

(3) the operators are bounded from LL 1 to L 1 (Section [7j); 

(4) the operators Sij and Ry are not bounded from H 1 to L 1 (Sections [HI ED- 

We remark that since the interpolation spaces between H l and L? for the real interpolation 
method are the LP spaces for 1 < p < 2 (see [V]), the boundedness of Ri and T^- from LL 1 to 
L l implies their boundedness on LP , for 1 < p < 2. 



BOUNDEDNESS FROM H 1 TO L 1 OF RIESZ TRANSFORMS 5 

The Riesz operators, and in particular their boundedness on LP and on the Hardy space 
H 1 , have been studied on various Lie groups and Riemannian manifolds. Many results in 
the literature concern "doubling spaces", i.e., measured metric spaces where the volume of 
balls satisfies the doubling condition. In this context, the Hardy space H 1 is defined as in 
[CW], 

In the classical setting of ~R n , the Riesz transforms are bounded on L p for 1 < p < oo, of 
weak type 1 and bounded on H 1 [Stl III. 3]. 

For nilpotent Lie groups and first-order Riesz operators, the L p -boundedness, for 1 < p < 
oo, the weak type 1 and the if ^boundedness were proved by N. Lohoue and N. Varopoulos 
[LVj . Subsequently, this was extended to all connected Lie groups of polynomial growth by 
L. Saloff-Coste [SCj and G. Alexopoulos [X]. 

In the setting of symmetric spaces of noncompact type, J. -P. Anker [A2j considered Riesz 
transforms associated with the Laplace-Beltrami operator. He proved the weak type 1 
estimate for the first-order operators and the //-estimates for operators of arbitrary order. 

On a Riemannian manifold the Riesz transform R = VA~ 1//2 , where V is the gradient and 
A is the Laplace-Beltrami operator, has been considered. If the manifold has nonnegative 
Ricci curvature, then the Riesz transform R is bounded on L p , 1 < p < oo, of weak type 1 
and bounded from H 1 to L l jB jlCLj . Subsequently, T. Coulhon and X.T. Duong proved that 
on a Riemannian manifold with the doubling property whose heat kernel verifies an upper 
estimate on the diagonal, R is of weak type 1 and bounded on L p , for 1 < p < 2 [CDlj . The 
connection between the L p -boundedness of the Riesz transform, Poincare inequalities and 
heat kernel estimates is also studied in \AC\ IACDHI ICD21 [CL2J. In Riemannian manifolds 
satisfying the doubling condition and the Poincare inequality, E. Russ [R] proved that R is 
bounded from H 1 to L 1 ; then M. Marias and Russ [MRJ proved the boundedness on if 1 of 
the linearized Riesz transforms. 

The previous results do not apply to our space (G,d,p), since it is of exponential growth 
and the doubling condition fails. 

Our paper is organized as follows: Section [2] contains the analysis of the kernels of the 
Riesz transforms. The H 1 — L ^boundedness of the operators Ri is proved in Section [3j as a 
consequence of a general boundedness theorem for integral operators. In Section HI we prove 
the unboundedness from if 1 to L 1 of the operators Si and 5*2, and in Section [5] that of So- 
We analyze the local part of the second-order Riesz transforms in Section 0, proving that 
they are bounded from H 1 to L 1 . In Section [7] we show that the operators T^- are bounded 
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from H 1 to L 1 . Finally, we show that the global part of the operators Sij and Rij are not 
bounded from H 1 to L 1 in Sections [8] and [91 

In the following, C denotes a positive, finite constant which may vary from line to line 
and may depend on parameters according to the context. Given two quantities / and g, by 
/ ~ g we mean that there exists a constant C such that 1/C < / jg < C. 

2. The convolution kernels of the Riesz transforms 

In this section, we analyze the convolution kernels of the Riesz transforms of the first and 
the second order. First recall that the definition of the convolution of two functions /, g on 
G is 



f*g{x)= / f(xy 1 )g(y)dp(y) Wx G G . 
Jg 



Let V denote the space {Am : u G C%°(G)}. In |GS1] it is verified that V is a dense subspace 
of L 2 and that V C D(A^ 1 ) C D(A -1 / 2 ). For a > 0, we denote by U a the convolution kernel 
of A- Q / 2 , in the sense that A~ a / 2 f = f*U a , for all / G V. Since 

T(a/2) 

we have that 

U n = ^Krz I t^ptdt 



r(a/2) 

where p t denotes the heat kernel of A. It is well known [GGGMl Theorem 5.3, Proposition 
5.4], jXDYl Formula (5.7)] that 



Pt(x) 



1 ^2 (;r) ^) r 3/2 e -^l y xeG ^ 



^7r 3 / 2 sinhr(x) 
where r(x) denotes as before the distance of x from the identity. Hence, for a < 3 

1 «i/2t.i r M fw-irW.-* 



' " 8 l ' 2 (x) . T !" X \ x f°° rixr- 3 ^-^ dv 



r(a/2) 7r 3 / 2 sinhr(x) 

= C^ 1 / 2 (a:) W , Va;GC7. 
smh r(x) 

We consider the cases a = 1 and a = 2 and get that G\ = and C7 2 = j-. We denote by 
U = U\ the convolution kernel of A~ 1//2 given by 

(2.1) y( g ) = J-fli/gfr) 1 VxGC7, 

27r 2 r(x) sinnr(x) 
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and by W = U2 the convolution kernel of A -1 given by 

(2.2) W(x) = — 5 1/2 {x) - , . VigG. 

47r sinhr(a;) 

Since i?j = X{ A -1 / 2 , we get for all f E V and x E G 

Rif(x) = Xi{f * C/)(x) = y X^fixy- 1 ) U(y) dp(y) 
= lim / X i>x f(xy- 1 )U(y)dp(y) 

e ^ Jr(y)>e 

= -lim / X iM f(xy- 1 )U{y)dp(y) 

£ ^°Jr(y)>e 

(2.3) = lim / /(xy- 1 ) X i>y U{y) dp(y) , 

where the last step follows by integration by parts, as in [S] Section 3]. Thus the convolution 
kernel of Ri is the distribution pv where fcj = X^J . Moreover, for f E V and x £ supp/ 



G 



G 



RJ(x)= I f(xy)k l ( y ^)d\( y ) 

f(y) k(y~ 1 x)5(y)dp(y) 
(2-4) = / f(y)R i {x,y)dp{y), 

JG 

where Ri(-, •) denotes the integral kernel of R4, related to fcj by 

(2.5) Ri{x, y) = S(y) h(y^x) Vx, y E G, x^y. 

We now consider the operators S^. By arguing as in [GS2\ page 246-247], it is easy to see 
that if / E C C °°(G), then XJ E Z^A" 1 / 2 ), so that S { is well defined on C C °°(G). Moreover, 
for all / E C™(G) and g E V 

(Sif,g) = (A'^X^g) = (XiftA-Wg) = -(f,X t A^ 2 g) = -(f,R i9 ). 

Thus by (12. 5p we deduce that the integral kernel of Si is given by 



(2.6) Si(x,y) = -Ri(y,x) = -5(x) h(x l y) Vx, y E G, x^y. 

We now compute k{ explicitly. To do so, we shall need the following simple lemma. 
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Lemma 2.1. At any point (xi,x 2 ,a) 7^ (0,0, 1) in G, the derivatives of r along the vector 
fields Xi are given by 



X i r(x ll x 2 ,a) 



s'mhr(xi,X2,a) 

Proof. It suffices to differentiate the expression 



a— a 1 —a 1 (x^+x|) a— coshr jf ^ Q 

2 sinh r(x i, x 2, a) sinhr 

if i = 1,2. 



cosh r(xi, x 2 , a) 



a + a 1 + a l (x\ + x 2 ) 



with respect to X^. For X = ad a we obtain 
sinhr(xi, x 2 , a) X r(xi, x 2 , a) 



1 — a 2 — a 2 {x\ + x\) 



which gives the result for i = 0. The cases of X$ = ad Xi , i = 1, 2, are similar. 
By (12 .ip and Lemma I2TT1 for i — 1,2 and (xi,x 2 ,a) ^ (0,0,1) we get 

ki(x 1 ,x 2 ,a) = X i U(x 1 ,x 2 ,a) 

1 _ 1 sinhr + r coshr 

a - — Xir(xi,x 2 ,a) 



(2.7) 



2tt 2 
1 

'2^2 



0/ tXj r 



r 2 sinh 2 r 
sinh r + r cosh r 

r 2 sinh 3 r 



For i = and (xi, x 2 , a) 7^ (0, 0, 1) we get 
k (xi,x 2 ,a) = X U(x l ,x 2 ,a) 



2tt 2 L 
1 



— 00 



r sinhr 



1 sinhr + r coshr 

~ a 9 • 1 2 Aor(xi,z 2 ,a) 

r^ sinh r 



— a 



-1 



(21 



2vr 2 

-U(xi,x 2 ,a) + 



— a 



, x a — a 1 — a 1 (x 2 + x 2 ) sinh r + r cosh r 



r sinhr 2 r 2 sinh 3 r 

1 — 1 + a -2 + a~ 2 [x\ + a; 2 .) sinhr + r coshr 



2tt 2 



r 2 sinh 3 r 



□ 



We now consider the second-order Riesz transforms. We shall regard A -1 as the operator 
of convolution by the kernel W. The operators Rij = XiXjA^ 1 , Sij = A _1 XiXj, Tij = 
X i A~ 1 Xj are then properly defined on C%°(G), with values in C ao (G). By arguing as in 
[GS1, Lemma 6] we may show that there exist distributions k%j, £{j, gij such that for any 

/ g cr(G) 

Rijf = f * kij Sijf = f * £ij Tijf = f * g^ ■ 
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To compute these convolution kernels, we recall some simple properties of right- and left- 
invariant vector fields, which are the analogs of those proved in |GS1[ Section 4.2] with 
respect to the measure A. 

Given a vector Z in g, we here denote by Z r and Z e the right-invariant and left-invariant 
vector fields on G which agree with Z at the identity, defined by 



d 



d 



Z r f(x) = - j(exp(tZ)x) and Z l f{x) = - j(xexp(tZ)) 



t=o dt 



t=o 



for any / G C°°(G) and x G G. It is easy to check that for any / G C°°(G) 

(2.9) Z r f = (Z'fY . 

Let k be a distribution on G, f G C C (G) and g G C%°(G). Then 

(2.10) (f*k,g) = (kj*g). 

The left-invariant derivative Z t k of k is the distribution such that for any g G C%°(G) 

(2.11) (Z%g) = -(k,Z e g). 
If /, & GC C °°(G), then 

(Z r f,g) = (f,-Z r g) + Z5(e) (f,g). 

So it is natural to define the right-invariant derivative of a distribution k as the distribution 
Z r k for which 

(2.12) {Z r k, g) = (k, -Z r g) + Z5(e) (k, g) Mg G C?(G) . 
It is easy to verify that 

(2.13) Z l (f*k) = f*Z ( k and Z r (f * k) = Z r f * k . 
By (12101) and (12121) we deduce that 

(2.14) Z € / * k = f * ( - Z r k + Z8{e)k) . 
Applying (12131) we get that for any / G C C °°(G) 

Rijf = XiXjA- 1 / = XiXj(f * W) = Xi(f * XjW) = f * X t X 3 W . 
Thus the convolution kernel of Rtj is 

(2.15) k lj = X l X j W, 

the derivative taken in the distribution sense. We denote by Rij(-, ■) the integral kernel of 
R i:j defined by Rij(x,y) = S(y) for x ^ y. 
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Moreover, by fl2TTTT) for all f, g e C C °°(G) 

(S tJ f,g) = (A^ 1 XiXjf,g) = (X^^A^g) 
= -(X J f,X l A- 1 / 2 g) = (f,R 3l g). 

This implies that the integral kernel of is given by 

(2.16) S i:j (x, y) = Rji(y, x) = 6(x) k^x^y) \/x / y . 

It easily follows that the convolution kernel of is £y = 5kji. 
Applying f[2TTD . we get that for any / G C™(G) 

T {j f = X t A- l X 3 f = X t {X 3 f * W) 

= X 3 f * X t W = f * ( - X]X t W + X j 5(e)X t W) . 

Thus the convolution kernel of Tij is gij = —X^XiW + Xj5(e)XiW . 

To avoid long computations, we do not compute explicitly the kernels of the second- 
order Riesz transforms, but we shall find their behavior away from the identity, i.e., in the 
complement of the unit ball B\. 

In the sequel, we shall denote by R(r) any series of the type YlT=i c k e ~ 2k7 \ where the 
are real numbers and the series is convergent for r > 1; we denote by S(r) any function 
of the type 1 + R(r). These functions may vary from occurrence to occurrence. It is easy 
to see that a function S(r) = 1 + R(r) may be differentiated termwise and its derivative is 
S'(r) = R(r). Moreover, multiplying two functions of the type S, we obtain a function of 
the same kind. 

Lemma [2.11 implies that for points (x\,X2,a) G B\ 



2 Xi e~ r S(r) Hi = 1,2 

2ae~ r S(r) - S(r) if i = , 



(2.17) X i r(x 1 ,x 2 ,a) ■ 
and by 

(2.18) W(x u x 2 ,a) = ^-a- l e~ r S(r). 

Z7T 

Let 1? + be the set of m = (m , mi, 777.2) m ^ 3 such that mi, m 2 > and mo > — 1. We denote 
by \m\ the sum mo + mi + m 2 and by x m the product The principal term of 

W is of the type x m e~ pr , where |m| —p = —2. We shall study the integrability of similar 
expressions in an elementary lemma, and first split B\ into two parts, as follows: 

G + = {(xi, x 2 , a) G B\ : a > 1} , 
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and 

G- = {(x\, x 2 , a) G B\ : a < 1} . 

Lemma 2.2. Let m be in 1? + and p G N. 

(i) The function x m e~ pr is integrable in G + if and only if 

(2.19) mi + m 2 — 2p < — 2 and |m| — p<— 2. 

(ii) The function x m e~ p r is integrable in G- if and only if 

(2.20) m 1 +m 2 -2p<-2 and m + p > . 

Proof. If (xx, X2, a) G G + , then e r ~ a (1 + a -2 | (rci, a^)! 2 ), so that 

a mo |xi| mi \x 2 \ m2 e~ pr dx 1 dx 2 — 
g+ a 

~ / a mo / |x!| mi |x 2 r 2 a- p (l + a- 2 |(x 1 ,x 2 )| 2 )- p dx 1 dx 2 — . 
Ji Jir2 a 

Under the change of variables a _1 (xi, x 2 ) = (yi, y 2 ), this transforms into the product 

poo p 

/ aH-p+Ma / Ij/in^ra + Kyi.^lVdyi^a- 

Here the integral in a converges if and only if \m\ —p< —2. By means of polar coordinates, 
the second integral is seen to converge if and only if m\ + m 2 — 2p < —2. This proves (i). 
If (xi, x 2 , a) G G-, then e r ~ a" 1 (1 + | (xi, x 2 )| 2 ), so that 

a mo |xi| mi \x 2 \ m2 e" pr dxi dx 2 — 
a a 

a mo+ P -l da I \ Xl \^\ X2 \^(l + \( XljX2 )\ 2 )-Pdx 1 dx 2 , 

Jr 2 

and (ii) follows. □ 

To study the higher order derivatives of W, we start with the derivatives along X , X±, X 2 
of an expression x m e~ pr S(r), as above. We shall always have 

(2.21) mi + m 2 — 2p < — 2 \m\ — p < —2 and ^o+P^O, 

which does not imply the integrability of x m e~ pr . For many remainder terms, we shall 
denote by Q(x) any finite sum of terms x n e~ qr R(r), where \n\ — q < —2, n + q > and 
rii + n 2 — 2q < —2, so that Q(x) is integrable in B\. By ( I2.17P we get that in F>\ 

(2.22) Xi (x m e- pr S{r)) = mi a mo+1 X™ 1 ' 1 x™ 2 e~ pT S(r)- 
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- p a mo x? 1 x2*e- pr 2xi e~ r S{r) + 

+ a mo x^x^e- pr R{r) 2x x e~ r S(r) 

= mi a mo+1 xr _1 < 2 e~ pr - 2pa m °x™ 1+1 x™ 2 e-( p+1)r + 

(2.23) + Q(x). 

By symmetry an analogous formula holds for i — 2. From (12.171) we get 

(2.24) X (x m e- pr S{r)) = m a m ° x™ 1 x™ 2 e~ pr S{r)- 

- p a^x^x™ 2 e~ pr [2a e~ r S{r) - S(r)] + 

+ a m °x^x^ 2 e~ pr R{r) [2ae~ r S(r) - S{r)] 

= (m +p) a mo x? 1 x2 a e~ pr - 2pa mo+1 x™ 1 x 2 n2 e~ {p+1)r + 

(2.25) +Q(x). 

Differentiating the expression (12.181) for W and applying (12.221) and (I2.24p . we get that in 

XjW(x\, x-ii a) = a^Xj e~ 2r + Q(x) if j = 1, 2, 

2n 

and 

X W(xi, x 2 , a) = - — e~ 2r + Q{x) . 

We now differentiate W a second time, applying again ( 12.22ft and (12.241) and also the ob- 
servation that XjQ(x) = Q(x), for i,j = 0,1,2. The result is that there exist constants 
ctij, (3ij G R and m, n G such that in B\ 

(2.26) kij(x) = odj x m e~ 2r + f3 {j x n e" 3r + Q(x) , 

where /3y ^ 0, \m\ = 0, |n| = 1, 777,1+777.2— 4 < —2, ni+n 2 — 6 < —2, m +2 > and n +3 > 0. 
This means that kij has a principal part in given by at most two nonintegrable terms, while 
the remaining part of the kernel is integrable. Finally, we estimate the derivative of k^ along 
the vector field X 2 . We get that, for i, j = 0, 1,2, there exist constants 7^, rjij, Uij, 9ij G R 
and h, £, m, n G such that in B\ 

(2.27) X 2 k tj {x) = m x h e~ 2r + Vij x l e~ 3r + a tj x m e~ 3r + % x n e~ 4r + Q{x) , 
where % + 0, \h\ = 0, \£\ = \m\ = 1, \n\ = 2. 
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3. H 1 - L 1 -BOUNDEDNESS OF R4 

In this section we prove that the Riesz transforms Ri are bounded from H 1 to L 1 , for 
i = 0,1,2. 

This result is a consequence of the following boundedness theorem for integral operators. 
Note that the hypotheses of the following proposition are the same as those of [HS[ Theorem 
2.1]. 

Proposition 3.1. Let T be a linear operator bounded on L 2 such that T = ^2j eZ Tj, where 

(i) the series converges in the strong operator topology of L 2 ; 

(ii) every Tj is an integral operator with integral kernel Tjj 

(iii) there exist positive constants a, A, e and c > 1 such that 

(3.1) / \Tj(x,y)\(l + c?d{x,y)ydp{x)<A Wy G G; 
Jg 

(3.2) / \T j (x,y)-T j (x,z)\dp(x)<A(c?d(y,z)) a Vy,zeG. 
Jg 

Then T is bounded from H l to L 1 . 

Proof. We first show that there exists a constant C such that for any atom a 

(3.3) UTallx < C . 

Let R be the Calderon-Zygmund set supporting a, and denote by cr the center of R and 
by R* its dilated set (defined in Section [TJ. We estimate the integral of Ta on R* by the 
Cauchy-Schwarz inequality: 

(3.4) I \Ta\ dp < \\Ta\\ 2 p(R*) l/2 < C |T| L2 _ L2 \\a\\ 2 p(R) 1/2 < C |||T||| L2 _> L 2 . 
Jr* 

It is easy to show that from the estimates ( 13. lft and ( 13. 2p it follows that 

(3.5) sup sup / \T(x, y) — T(x, z)\ dp(x) < 00 , 

R£Hy,z£Rj (R*)c 

where T is the integral kernel of T. Thus the integral of Ta on the complementary set of R* 
is estimated as follows: 

T(x,y)a(y)dp(y) dp(x) 
[T(x, y) - T(x, c R )} a(y) dp(y) dp(x) 



\Ta\ dp < 
(R*r J{R*Y 



(R*Y 



R 
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< / / \ T (x,y) -T(x,c R )\ \a(y)\dp(y)dp(x) 

l(R*) c JR 



a (y)\\ / \T(x,y) -T(x,c R )\dp(x)) dp{y) 
< ||a||i sup / \T(x,y) - T(x,c R )\ dp(x) 

y£Rj(R*Y 



<c. 

This concludes the proof of (I3.3p . We shall deduce from (13.31) that T is bounded from H 1 
to L l . Indeed, by |HSt Theorem 2.1] T is bounded from L 1 to L 1,co . Now take a function / 
in H 1 and suppose that / = Y^jLi ^j a j * s an atomic decomposition with J2j ~ ll/lli? 1 - 
Define fjy = X}jLi A 3 -Oj. Since /n converges to / in L 1 , Tfjy = J2f=i ^jTa-j converges to Tf 
in L 1,OQ . On the other hand, by (13. 3p 

oo oo oo 

\\Tf N -^XjTajW! < l A il H Ta illi ^ C Yl l A J'l ' 

j=l j=N+l j=N+l 

so that T/n converges to YlJLi ^jTaj in L 1 . This implies that Tf = YlJLi ^j^ a j e L 1 and 

l|r/||i<c ii/n^. □ 

We now easily obtain the following theorem. 

Theorem 3.2. The Riesz transforms Ri, for i — 0, 1, 2, are bounded from H 1 to L 1 . 

Proof. In the proof of |I IS} Theorem 6.4], it is shown that the operator Ri satisfies the 
assumptions of Proposition 13.11 Thus Ri is bounded from H 1 to L 1 . □ 

4. Unboundedness of Si and S 2 

In this section we prove that the Riesz transforms S\ and S 2 are not bounded from H 1 
to L 1 . To do so, we shall define an atom a on G such that the images of a under these 
operators are not integrable in a region far from the support of the atom (see Theorem 14. 2p . 
By symmetry it suffices to consider the case i = 1. 

Differentiating the expression (12.71) for k\ along the vector field X 2 and applying Lemma 



12.11 we obtain that 

~r 2 sinh 3 r(2 coshr + r sinh r) 



X 2 ki(xi, x 2 , a) = r a 1 X\ X 2 r(xx,x 2 , a) 



r 4 sinh r 

(sinh r + r cosh r) (2r sinh 3 r + 3r 2 sinh 2 r cosh r) 
r 4 sinh 6 r 
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, A . 1 ajiij 2 r 2 cosh 2 r + r 2 + 2 sinh 2 r + 3r sinh r cosh r 

= ^ a ~ T T - T4 • 

2 7T^ smhr H sinh r 

Lemma 4.1. There exist regions T" C f C T, a positive continuous function $ on F and a 
positive constant C such that 

(i) X 2 h >C$ inV; 

(ii) for any (a?i, X2, a) «n r" and r m [0, 1/4], i/ie point (a?i, £2, a) • (0, r, 1) is m T and 

$((xi,x 2 ,a) • (0,r, 1)) = x 2 ,a) ; 

(iii) J r „ $ dp = oo . 

Let E be the parallelepiped (-1/2, 1/2) x (-1/4,0) x (1,2). Then 

(4.2) r" -E- 1 -ECT' . 

Proof. Given B, A > 1 and < e < 1 we define T as the region 

T = {(xi, x 2 ,a) <E G : 1 — e < x 2 jx\ < 1 + e, x\ > Ba, a > A} . 
For any (xi,x 2 , a) in T we have that 

— - — < coshr(xi, X2, a) < C cT 1 x 2 , 

and r(x\, x 2 , a) > 1, for A and I? sufficiently large. Moreover, since e r < 2 coshr < C a~ x xf, 

r(xi, x 2 , a) < C log(a _1 x\) . 

By the formula (14.11) it is clear that X 2 k\ is positive on V . Considering the first term in the 
numerator of the last fraction in (14. ip . we see that for (xi,x 2 ,a) in V 



X 2 k±(xi, x 2 , a) > C a x l > C 

We define 



-i ,2 \ ~> Q a 1 xl 

r cosh 3 r "~ log(a _1 xf) (a _1 x 2 ) 3 



$(x 1 ,x 2 ,a) 



log(a _1 xf) (a -1 x\) 2 ' 
The condition (i) is verified. We now define 

r' = {(xi, x 2 , a) G T : 1 — e' < x 2 jx\ < 1 + e', X\ > B'a] , 

r" = {(xi, x 2 , a) e r : 1 - e" < x 2 jx x < 1 + e" , x 1 > B"a, a > 2A} 

where B" > B' > B, < e" < e' < e < 1 have to be chosen. 
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Let (xi, x 2 , a) be a point in T' and r in [0, 1/4]. Then (xi, x 2 , a) ■ (0, r, 1) = (xi,x 2 + ar, a) . 
It is easy to see that we may choose B', e' such that (xi, x 2 + a r, a) G T. Moreover, 

*((*!, x 2 , a) ■ (0, r, 1)) = log{a - lx2Ha - lx2)2 = x 2 , a) , 
as required in (ii). To prove (iii), we integrate $ over T" and obtain 

f°° r [ {1+£ " )X1 1 , , da 

=c r r - dan da 

= c r r du d ^ 

> C / — : da 

J 2yl a log a 

= oo . 

Given (xi,x 2 ,a) G T" and (yi,y 2 ,b), (zi,z 2 ,c) G -E, we have 

(x u x 2 , a) ■ (y u ?/2, 6) _1 ■ (z l5 z 2 , c) 
= (x x + a6 _1 (^i - yi),x 2 + ab~ 1 (z 2 - y^.ab^c) , 

where ab~ 1 c > 2A/2 = A, and 

xi + ab- 1 (z 1 - Vl ) > B"a - ab' 1 > B"a/2 > B'ab^c, 
for B" sufficiently large. Moreover, 

x 2 + ab^ 1 (z 2 - y 2 ) > x x {\ - e") - ab~ l /A 

= xi(l - e') + (e' - e")xi - ab^/A 
>x 1 {l- e') + (e' - e")B"a - ab~ x /A 
>x x (l- e') + [(e' - e")B" - 1/4] ab' 1 
> [xi + ab~ 1 (z 1 -yi)] (1 - e') , 
if e" < e' and i?" is sufficiently large. In the same way, we can achieve 
x 2 + ab^ 1 (z 2 - y 2 ) < [xi + ab^ 1 (z 1 - yi)] (1 + e') . 
Thus the point (x±,x 2 , a) ■ (yi,y 2 ,b)~ 1 ■ (z±, z 2 , c) is in T', proving (14. 2L □ 

Theorem 4.2. The operators S± and S 2 are not bounded from H 1 to L l . 
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Proof. By symmetry, it is enough to treat the case of S±. We shall construct an atom a such 
that Si a does not belong to L 1 . Let R be the parallelepiped [ — e 2 log 2/2, e 2 log 2/2] x [ — 
e 2 log 2/2, e 2 log 2/2] x [1/2, 2]; it is easy to check that R is a Calderon-Zygmund set centered 
at the identity. Now let E be the parallelepiped defined in Lemma 14.11 and consider the 
right translate E a of E by the point exp(<rX2) = (0, a, 1) for some a > 0, i.e., 

E a — E ■ (0, a, 1) = {(y u y 2 + ba,b): (y u y 2 , b) G E} 
C (-1/2, 1/2) x ( - 1/4 + a, 2 a) x (1, 2) . 

With cr = 1/4, and are disjoint and contained in R. 

Let us consider the function a = p(i?) _1 (l^ — Ie*). It is obvious that a is supported 
in the Calderon-Zygmund set R and ||a||oo < p(-R) -1 - Moreover J a dp = and so a is an 
atom. We now compute Si a outside the support of a. For all x ^ E U 

Sia(x) = / S 1 (x,y)a(y)dp(y) 



= p(R)- 1 / S l (x,y)dp(y)-p(R)- 1 / S^x^dpiy). 

J E J E a 

Changing variable ?/ = f ■ (0, cr, 1) in the last integral, this transforms into 
p(R)- 1 [ S 1 (x,y)dp(y)-p(R)- 1 [ S 1 (x,v ■ (0, a, 1)) dp(v) 

J E J E 

= p(R)- 1 [ [S 1 (x,y)-S 1 (x,y (0, <r, 1))] dp(y) . 
By (12.61) we know that 

Si(x,y) - Si(x,y- (0, a, 1)) = 5(a;) ( - k^x^y) + /c i (a;^ 1 ?/exp(crX2))) 

= 5(a;)cr^- k 1 (x~ 1 yexp(tX 2 )) 

UL t=r(x,y) 

= 8(x) a X 2 ki(x~ 1 yexp(r(x,y) X 2 )) , 



for some r(x, y) in (0, a). It follows that for all x ^ E U 

(4.3) Sia(x) = p(i?)- 1 ( x ( 5(a;) / X 2 A;i (x"^ exp(r(a;, y) X 2 )) dp(y) . 

Je 

To prove that Si a is not in L 1 , we integrate |Sia| in the region E (r")" 1 , where T" is the set 
which appears in Lemma [4.1[ It is easy to check that E (r") _1 is disjoint with E U E a , so 
that we can apply (14. 3p in the region E (r") _1 and obtain 



|Sia(x) I dp(x) 



e (r") _ 
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= p(R) 1 cr / 8(x) / X 2 h(x 1 yexjp(r(x,y)X 2 )) dp(y) dp(x) 

J EAT")- 1 JE 

= p(RY l o \ \ X 2 k 1 (xyexp(r(x~ 1 } y)X 2 ))dp(y) dp(x) . 

Jt" e- 1 Je 

If x G r" E~ l and y G E, then xy G T', in view of (14.21) . Since < r(x^ 1 ,y) < o 
Lemma [4. II the point rq/exp(r(:r _1 , y) X 2 ) is in V and 

X 2 k x (xy exp^ix' 1 ,y) X 2 )) > C $(xy exp(r(x _1 , y) X 2 )) = C <$>(xy) . 

Hence, applying Fubini's theorem and using w = xy instead of x, we get 

/ \S 1 a(x)\dp(x)>Cp(R)- 1 a [ [ ${xy) dp(y) dp(x) 

J e (r")- 1 JvE' 1 Je 

= Cp(R)- 1 a [ dp(y) [ dp(w) 
Je Jr" E~ 1 y 

>Cp(R)- l o I dp(y) I dp(w) . 

Je Jt" 

Lemma 14.11 (iii) implies that this integral diverges. 



1/4, by 



□ 



5. Unboundedness of S 

To prove that the operator So is not bounded from H 1 to L 1 , we use the same idea as in 
the previous section. The only difference is that we consider now the derivative X ko in a 
slightly different region. 

We first compute the derivative of the expression (12. 8p for ko along the vector field Xq: 



X k (x 1 ,x 2 ,a) 



+ 



1 I — a — a {x\ + x 2 ) sinhr + r coshr 



2 7T 2 r sinh r 2 7r 2 

1 r -2 , -2/ 2 i 

[a + a [Xi + 



r 2 sinh r 



2 n 2 
1 



x, 



sinh r + r cosh r 



+ 



r 2 sinh r 

-1 + a~ 2 + a~ 2 (x\ + xl) a - a" 1 - a~ 1 {x\ + x\) 

~\~ — — - — : — : X 



2tt 2 



2 sinhr 



(2 cosh r + r sinh r)r 2 sinh 3 r 
r 4 sinh 6 r 

(sinh r + r cosh r) (2r sinh 3 r + 3 r 2 sinh 2 r cosh r) 



1 a" 



r 4 sinh r 

1 1 — 3 a -2 — 3 a~ 2 (x? + xV) sinhr + r coshr 
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1 _ x [a - a~ l - a~ l (x\ + x 2 )] 2 

\ 77 CL X 

2tt 2 4 

. , 2 r 2 cosh 2 +r 2 + 2 sinh 2 r + 3 r sinh r cosh r 

(5.1) x = . 

r 3 sinh r 

Lemma 5.1. There exist two regions Q' C Q, a positive continuous function ^ on Q and a 
positive constant C such that 

(i) X k >Cm in Vt; 

(ii) for any (xi,X2,a) in Q and r in [0, 1], the point (x\,x 2 ,a) ■ (0,0, e r ) is in Q and 

V((x u x 2 ,a) ■ (0,0, e r )) > CV(x 1 ,x 2 ,a) ; 

Let F be the parallelepiped (-1/16, 1/16) x (-1/16, 1/16) x (1, y/2). Then 

(5.2) fl'-r'-FCfi. 

Proof. Let A > 1 be a constant to be chosen later and define 

= {(xi, x 2 , a) E G : x\ + x\ < a 2 /A, a > A} , 

(5.3) n' = {(xi, x 2 , a) EG: x\ + x\ < a 2 /64, a > V2A} . 

For all (xi,X2,a) in Q 

— < coshr(xi, x 2 , a) < C a . 

For A sufficiently large, r(xi,x 2 ,a) > 1 here, and, since e r < 2 cosh r < C a, we have 
r < C log a. 

It is easy to show that in the region Q all the summands which appear in the last expression 
in (15.11) are positive, so that for all (xi,x 2 ,a) in Q 

X k (xi,x 2 , a) >C — — — > 



r sinhr ~~ a 2 log a 
We define 



a 2 log a 
The condition (i) is satisfied. 

Let (xi, x 2 , a) G Q and r G [0, 1]. It is easy to check that the point (xi, x 2 , a) ■ (0, 0, e 7 
(xx, x 2 , ae T ) is in Q. Moreover, 

*((x u x 2 ,a) • (0,0, e r )) = 1 > C = C*(x u x 2 , a) , 

v ' a 1 e ZT log(a e T ) a 2 log a 
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as claimed in (ii). To prove (iii), we integrate \& over Q' and obtain 

/ ^dp= f — ^ f [ dxida; 2 — 

Jn> JV2A a lOg a J Jxf+x%<a?/&i a 

r°° 1 

= C / da 

JV2A « log a 

= oo . 

Given (xi,x 2 , a) G Q' and (yi, y 2 , b), (z\, z 2l c) G F, we have that 

(ari, x 2 , a) ■ (j/i, 2/2, o) -1 • (21, z*, c) 
= (xi + ab^ 1 (z 1 - yi), x 2 + ab^ 1 (z 2 - y 2 ), a6 _1 c) , 

where ab~ l c > \[2Aj\f2 = A, and 

[xi + afc -1 ^ - yx)} 2 + [x 2 + afe -1 ^ - y 2 )] 2 

< (|xi| + a/8) 2 + (|x 2 | +a/8) 2 

< 2 (1/8 + l/8) 2 a 2 

< (a&^c) 2 /^ 

Thus (xi, x 2 , a) • (yi, y 2 , • (zi, -22, c) G f2, and (j5.2p is proved. □ 
Theorem 5.2. TTie operator So is not bounded from H 1 to L 1 . 

Proof. Following closely the proof of Theorem \4.'2\ we shall construct an atom a such that 
Soa does not belong to L l . With R as in that proof, we let F be the parallelepiped defined 
in Lemma [5.11 and consider the right translate F a of F by the point exp(o"X ) = (0,0, e CT ), 
i.e., 

F CT = F- (0,0, e CT ) = {(yi,^,oe ff ) : (yi,y 2 ,&) e F} 
= ( - 1/16, 1/16) x ( - 1/16, 1/16) x (e a , e a V2) . 

With a = (log2)/2, F and F a are disjoint and contained in R. 

Let us consider the atom a = p(R)~ x [If — 1f ct )- We compute Soa outside the support of 
a. For all x £ F U F a 

S Q a{x) = p(RY 1 I S (x,y)dp(y) - p(R)- 1 S (x,y)dp(y) 
Jf Jf" 

= p(R)- 1 J [S (x, y) - So (x, y ■ (0, 0, e CT ))] dp{y) . 
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By (12.61) we know that 

S (x,y) - S (x,y (0,0, e ff )) = 5(x) ( - ^(x^y) + k^x^y exp(cr X ))) 

fc (^ _1 ?/exp(tXo)) 
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5(x) a — 
v ; dt 



t=r(x,y) 

8(x)aX k {x~ x y exp(r(a;, y) X )) 



F(O')- 



for some r(x, y) in (0, a). It follows that for all x ^ F U F a 

(5.4) S'oa(x) = p{R)~ l a8{x) J X k (x~ 1 yexp(T(x,y)X ))dp(y). 

To prove that Sod is not in L l , we integrate 5*oa in the region F (f2') _1 . It is easy to verify 
that F (fi') _1 1S disjoint with F U F a , so that we can apply (15.41) and obtain 

|5 , a(a;) | dp(x) = 

= p(Ry 1 a / 5{x) / X k (x~ 1 yexp(T(x,y) X )) dp(y) dp(x) 

JFifl')- 1 Jf 

= p(R)- 1 cr / / X k (xyexp(T(x~ 1 ,y)X ))dp(y) dp(x) . 

Jn'F- 1 Jf 

If x G fi'-F -1 and y & F, then G f2, in view of (15.21) . Since < r(x~~ 1 ,y) < a < 1, by 
Lemma [5.1( h) the point xyexp(r(x~ l , y) Xq) is in Q and 

X /c (a;?/exp(r(x- 1 ,y)X )) > C ^(xy exp(r(x-\ y) X )) > C^(xy). 

As in the proof of Theorem 14.21 we get 

/ \S a(x)\dp(x)>Cp(R)- 1 a [ [ V(xy) dp(y) dp(x) 
JFin')- 1 Jn'F- 1 Jf 

= Cp(R)- 1 a [ dp(y) [ <St(w) dp(w) 

Jf Jn'F^y 

>Cp{RY l a [ dp(y) [ V(w) dp(w) . 
Jf Jw 

Lemma 15.11 (iii) implies that the last integral diverges. 



□ 



6. The local parts of T ij: and R tj 



In this section, we study the local parts of the kernels of the second-order Riesz transforms. 
We shall prove that they behave like standard Calderon-Zygmund kernels in M 3 and deduce 
that they correspond to operators which are bounded from H 1 to L 1 . 
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Let \I> be a function in C^°(S) such that < ^ < 1, \& is supported in the ball B 2 of 
radius 2 and $ = 1 on the ball B\. Define 



4 


= 9ij* 


and 




= 9ij 


(1 


-*), 


K ij 


= * 


and 


LOO 

% 


- h ■ 


(1 


-*), 




= % * 


and 


poo 
Hj 


= £ij ( 


;i 





and let T^, T??, R°°, and be the corresponding convolution operators. We shall 
prove that the operators T-j, _R°- and Sfj are bounded from H 1 to L 1 . To do so, we use the 
following lemma. 

Lemma 6.1. Let T be a convolution operator which is bounded on L 2 . Suppose that its 
kernel k is a distribution supported in the ball B 2 and given by a function in B 2 \ {e}. Define 

(6.1) p((xi,X2,s), (2/1,1/2,*)) = <%i, 2/2, e*) k((yi,y 2 ,e t )~ 1 - G (x 1 ,x 2l e s )) 
for any (xi,x 2 ,s) 7^ (yi,y 2 ,t) £ M 3 . satisfies the standard estimate 

(6.2) |/5(x, y)| + |x - y| [|V x 0(x, y)| + | V y /3(x, y)|] < C |x - y|- 3 , 

for |y| < 2A , x/y, where A is a suitable constant, then T is bounded from H 1 to L 1 . 

Proof. We first verify that the operator T is of weak type 1. Via a standard Calderon- 
Zygmund decomposition argument, the L 2 -boundedness of T and the estimate (16.21) imply 
that for any / £ L l (B\) 

p{{xeG:\Tf(x)\>t})<j\\f\\ l Vt>0. 

There exists a sequence of balls Bj, centered at points Xj and of radius 1, such that G = (J . Bj 
and each point of G belongs to at most n of the balls Bj (see |GQS[ Lemma 8]). From the 
left-invariance of the operator T, the right-invariance of the measure and a simple application 
of a partition of unity (if)j)j such that supp^- C Bj, we may deduce that for any / £ L 1 
and t > 



p{{x £ G : \Tf(x)\ > t}) < p{{x eG:J2 I^WX*)! > *}) 
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The inequalities above follow by a standard argument (see |GQS[ Lemma 7] for the details). 
Thus, T is of weak type 1. As in the proof of Theorem 13. 1[ the lemma will follow if we show 
that there exists a constant C such that ||T6||i < C for any atom b. 

Any atom b can be transformed by an appropriate left-translation into an atom a sup- 
ported in a Calderon-Zygmund set centered at the identity, and ||T&||i = ||Ta||i by the left- 
invariance of T. Thus, it suffices to consider an atom a supported in a Calderon-Zygmund 
set R = [-L/2, L/2] x [-L/2, L/2] x [e~ r , e r ] centered at the identity Recall that the dilated 
set R* is defined by {x G G : d(x, R) < r}. Since T is bounded on L 2 , 

(6.3) \\Ta\\ L i m < p{R*) 1/2 \\T\\ L 2^ L 2 \\a\\ 2 < C . 

Note that supp (To) CR-B 2 C{xeS: d(x, R) < 2}. 



If r > 2, then supp(Ta) CR-B 2 CR* : so that \\Ta\ 



\Ta\ 



< C. 



Suppose now that r < 2. Since r(xi,X2,a) ~ %2, loga)| near the identity, there exists 
an absolute constant A such that 

R C {(xi,x 2 ,a) : \(x 1 ,x 2} \oga)\ < A r} = B . 

Notice that B corresponds to a euclidean ball in M 3 . Since r < 2, p(B) ~ p(R) ~ r 3 and, by 
arguing as in (16.31) . we obtain that ||T'a||x,i(2B) < C . 

It remains to estimate the L 1 -norm of Ta outside 2B. Since the integral kernel of T is (3, 

we get 



|Ta(x)| dp(x) 



(2B) C 



(2B) C 



(2BY 



B 



a(y) /3(x,y)dp(y) dp(x) 

a(y) [P(x, y) - P(x, 0)] dp(y) dp{x) , 



which is bounded by 



(2B) C J B 



(3((x u x 2 , a), (y 1 , y 2 , b)) - (3((x u x 2 , a), 0) j 
dp(y u y 2 ,b) dp(x 1 ,x 2 ,a) . 



By changing variables a = e s and b = e*, we obtain 



\Ta\ 



L 1 (2B)' 



< Hal 



,x 



/ / 



'\(xi,x 2 ,s)\ >2A r J | (j/i ,V2,t) | <A r 

dyi dy 2 dt dxi dx 2 ds . 



|/3((a?i, x 2 , s), (y u y 2 , t)) - (3({x u x 2 , s), 0) 
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If |x| > 2A r and |y| < A r, by (16.21) we get 



so that 



|/?(x,y) -/3(x,0)| < sup |V y /3(x,y')||y|<Cr|x|- 4 , 

|y'|<A r 

||Ta|| L i (2 B) C < Halloo / / |/?(x,y) - /?(x,0)| dydx 

J\x\>2A Q r J\y\<A r 

< Cr~ 3 / / |x|~ 4 rdydx 

J\xi\>2A r J\y\<A r 

< c. 

□ 

Proposition 6.2. The operators T^, and Sfj are bounded from H 1 to L 1 . 

Proof. It is enough to apply Lemma ISTTl to the operators T° , i& and S®j. By |GS1| Theorem 
12] they are bounded on L 2 and their kernels gfj, kfj, £®j are supported in the ball B 2 . Let 
k denote one of the kernel g^, k^, We must show that the function /3, given by 

f3((x 1 ,x 2 ,s), (y 1 ,y 2 ,t)) = e~ 2t k(e~ t (x 1 - y{), e~\x 2 - y 2 ), e s ~ f ) , 

satisfies ( 16. 2p . By means of some elementary Taylor expansions in the variable x = (xi, x 2 , log a) e 
IR 3 , one finds that near e 

W(x 1 , x 2 , a) = — —r (1 + hi + h 2 + . . .) , 

47T |x| 

where each hj is a function of x which is homogeneous of degree j and smooth away from 
0, and the series Ylj hj converges near 0. Termwise differentiation is possible, and we let <9 a 
denotes a differentiation operator with respect to (xi, x 2 , logo), of order a. Then 

d a w = 7L Ha | + h H + . . . , 

with similar smooth homogeneous functions hj. This implies 

\d a W{x)\ < Clxl" 1 - 1 " 1 

for small x, and thus 

(6.4) \k(xi,x 2 ,a)\ + |(xi,x 2 ,loga)| \Vk(xi, x 2 , a)\ < C \(xi, x 2 , loga)|~ 3 

in B 2 \ {e}, where V denotes the gradient with respect to (xi, x 2 , log a). 
If (yi,y 2 ,t) is near the origin, we have 

\(3((xi,x 2 ,s), (yi, y 2 ,t))\ <C\k(e- t (x 1 -y 1 ),e- t (x 2 -y 2 ),e s - t )\ 
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< C\(e- t (x 1 - yi),e-*(x 2 - y 2 ), s - t)\- 3 

< C\(xi -yi,x 2 -y 2 ,s-t)\~ 3 , 

and 

\^(x 1 ,x 2 ,s)P((x 1 ,x 2 ,s), (y u y 2 ,t))\ + \ V(y 1 , va ,t)P{(x 1 ,x 2 ,s), (yi,y 2 ,t))\ 
<C\k{e- t {x 1 -y l ),e- t {x 2 -y 2 ),e s - t )\ + 
+ C\Vk(e~ t {x 1 - y 1 ),e~ t (x 2 - y 2 ), e*"*) | 
<C\(e- t (x 1 -y 1 ),e- t (x 2 -y 2 ),s-t)\- 4 
<C\(xi - y!, x 2 - y 2 , s - t)\~ A , 

and the theorem follows. □ 

7. BOUNDEDNESS OF T {j 

We shall prove that the operators Ty = XjA _1 Xj are bounded from H 1 to L . Since we 
already verified the boundedness of their local parts, it remains to consider the global parts. 

In |GS14 Lemma 9] it is proved that the global parts of the kernels g£j°° of the right- 
invariant Riesz transforms T[j are integrable with respect to the measure A. Since (12.91) 
implies that (l£/) v = T^f for any / G C™(G), we obtain that g$ = glf° . Thus g% is 
integrable with respect to the measure p and the corresponding convolution operator is 
bounded from H l to L l . 



8. Unboundedness of Sij 

In this section we prove that the operators are not bounded from H 1 to L l . Again 
it suffices to consider their global parts. To do so, we use the same idea as in Section HJ 
defining an atom whose image under the operator is not integrable far from the support 
of the atom. 

We will need to estimate some integrals of derivatives of the kernels kij. Notice that it is 
enough to treat the values of listed in the following lemma, since the remaining cases 
will follow by symmetry. 

Lemma 8.1. For each pair G {(1,1), (1,2), (1,0), (0,1), (0,0)}, there exist regions 

T" C r' C r in G, a positive continuous function $ on V and positive constants C, t such 
that 
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(i) \X 2 kij\ >C<f> in T; 

(ii) for any (xi, x 2 , a) in V and o in [0, r], the point (xi, x 2 , a) ■ (0, a, 1) is in T and 

$((xi, x 2 , a) ■ (0, a, 1)) = x 2 , a) ; 

(iii) J r „ $ dp = oo . 

Moreover, there exist constants < 5 < 1 and 1 < /3 < 2 swc/i t/iat t/ie parallelepiped 
E = (0,5) x (—5,0) x (1,(3) satisfies the condition 

(8.i) r" -e~ x -e c r. 

Proof. Let us fix a pair (z, j). To simplify the notation we write for the kernel fcy and drop 
the indices i,j. Because of f)2.27p . there exist constants 7, n, a, 9 G M and ft,, £, m, n E 2? + 
such that for a; in B\ 

X 2 k(x) =^x h e~ 2r + nx e e" 3r + a x m e" 3r + 9 x n e" 4r + Q(x) = F(x) + Q(x) , 

where F(x) is defined by the last equality. Here 9 7^ 0, \h\ = 0, |£| = \m\ = 1, |n| = 2. 
The remainder term Q(x) is as described in Section [2J For large a, (j 1.1ft implies e r ~ 
a + a _1 (x 2 + X2) 2 and more precisely, 

e r = a + a -1 (a; 2 + a; 2 ,) + a -1 — e~ r 

= (a + a-\x\ + xl)) (l + a+ fl a _ 1 ^ e +x|) ) • 

Inverting the last factor here and expanding, we see that for x = (x\,x 2 , a) with a large 

e~P r = a? (a 2 + x{ + xjy p (l + 0(e~ r )) = a p \x\~ 2p (l + 0(e~ r )) , 

where I ■ I denotes the euclidean norm in K 3 . Thus, for such x 



9x n a 4 + 


x\ 


2 [7 x h a 2 


\x 


2 + r] x e a 3 + a x m a 3 ] 




x\ 


8 



F(x) = ^ ^ s - + E(x) 

P(x) 



\x 



8 



+ E(x) 



where P is a polynomial in the variables x\,x 2 ,a, homogeneous of degree 6. Further, E(x) 
is a sum like F(x), but with e~ ( - p+1 ' )r ' instead of e~ pr in each term. We write P(x) = 9x n a 4 + 
\x\ 2 P(x), where P is homogeneous of degree 4. Notice that P is not identically 0, since 
the monomial x n a 4 cannot equal a product # _1 \x\ 2 P(x). We can thus find q\,q 2 > with 
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P(qi, q 2 , 1) 7^ 0. By continuity and homogeneity, P(x) ^ also for x in a narrow cone near 
the ray in the direction (gi, q 2 , 1), in particular for x in the truncated cone 

T = {(xi,X2, a) E G : a > A, \x\/a — q\\ < e, \x2/a — q 2 \ < e} , 

for some small e > 0. With A sufficiently large, this implies that in the region T the quantities 
\E\, \Q\ are much smaller than \F\ and so for any {xi,x 2 ,a) G T 

\X 2 k{ Xl ,x 2 ,a)\ >C\F(x 1 ,x 2 ,a)\ > C \ P ^ x ^ a }} > C a -\ 



[x 1 ,x 2 ,a 



Defining x 2 , a) = a 2 in T, we have proved (i) 
We define 



V = {( X i,x 2 ,a) G T : \x\/a — qA < e/2, \x 2 /a — q 2 \ < e/2] 



and 



r" = {{xi, x 2 , a) G r : a > 2 A, \x\/a — q\\ < e/4, \x 2 /a — q 2 \ < e/A] . 

Now choose r < e/2 and a G [0,r], and let (xi,x 2 ,a) be in T'. Then (xi,x 2 ,a) ■ (0, a, 1) = 
(xi, x 2 + aa, a). We have that |xi/a — gi| < e/2 < e and 

|(x 2 + aa)/a — q 2 \ < \x 2 /a - q 2 \ + a < e/2 + r < e . 

Thus (xi, x 2 + aa, a) G T and x 2 , a) • (0, a, 1)) = a -2 = x 2 , a). 

To prove (iii), it suffices to note that 

f —2 j i da Z" 00 _ 2 2 da 

/ a dx 2 d^i — > G / a a — = oo . 

Aiming at (18.11) we take points (xi,x 2 ,a) G T" and (yi,y 2 ,b), (zi,z 2 ,c) G i£ and consider 
(xi,x 2 , a) • (yi,y 2 , b)" 1 ■ (z±, z 2 , c) = (x\ + ab~~ 1 (z 1 - yi) , x 2 + ab^ 1 (z 2 — y 2 ), a6 _1 c). Obviously, 
ab- x c > 2A//3 > 2A/2 = A. Moreover, 



x x + ab 1 (z 1 - y x ) 



ab 1 c 



< 
< 



ab 1 c 

Xl 



Qi 



+ 



\zi - 2/i I 



c 



a 



Xi 

a 



6 



b/c-1 

< 2 qi \(3-l\ + e/4 + 6 
<e/2, 

for S sufficiently small and j3 sufficiently close to 1. In a similar way, we can achieve 

x 2 + ab~ l {z 2 - y 2 ) 



ab 1 c 



Q2 



< e/2 
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so that (xi, x 2 , a) ■ (y l , y 2 , b)' 1 ■ {z x , z 2 , c) G V, proving flSTTT) . □ 

Theorem 8.2. The operators Sij, for i,j = 0, 1, 2, are not bounded from H 1 to L 1 . 

Proof. As remarked above, we need only consider the operators Sn, S 2 %, S w , S i, S 00 . 

We argue as in the proof of Theorem 14.21 This time by (12.161) for all o > and x,y G G, 
with x 7^ y and x ^ y ■ (0, a, 1) 

(8.2) S i:j (x,y) - S i:j (x,y- (0,cr, 1)) = 5(x)aX 2 k ji (x' 1 yexp(r( y x,y)X 2 )) , 

where < r(x,y) < o and Sij denotes the integral kernel of the operator Sij. 

As in the proof of Theorem 14.21 one constructs an atom a such that J Sij(-,y)a(y) dp(y) 
does not belong to L 1 : it suffices to apply (18.21) and Lemma IHTLl We omit the details. □ 

9. Unboundedness of Rij 

In this section we prove that the operators Rij are not bounded from H 1 to L 1 , and it 
suffices to consider their global parts. The proof of the unboundedness of R°° is different 
from the previous cases. We shall now construct a sequence of functions in H l such that 
their images under the operator R°° lie in L 1 but have large Z^-norms. To do so, we first 
analyze the kernels kf°. 

Lemma 9.1. For any i,j = 0, 1, 2, there exists a splitting kf° = kjj + fcf„- + kfj such that 

(i) kjj = kf° X{(x 1: x2,a)eG: a<i} ^ integrable; 

(ii) kfj is supported in the region {(xi,x 2 ,a) G B\ : a > 1} and is integrable; 

(iii) kfj is supported in the region {(xi,x 2 ,a) G B\ : a > 1} and for any f G L 1 

f * ki j (x 1 ,x 2 ,a) = [tp a * R 2 h](xi,x 2 ) \/(x 1 ,x 2 ,a) G G, 

where h(xi,x 2 ) = J °° f(x±, x 2 , a) da/a, ip is a continuous function on IR 2 such that 
\ip(xi,x 2 )\ < C (1 + \(xi,x 2 )\)~ 3 for some C, and ip a {xi,x 2 ) = a~ 2 -?/'(a~ 1 Xi, a -1 ^) 
for a > 0. 

Proof. We fix a pair (i,j) and drop the indices i,j on the kernels. By (I2.26P there exist 
constants a, (3 and m, n G Z 3 such that in 

k°°{x) = ax m e~ 2r + f3x n e~ 3r + Q{x), 

where Q is integrable, (3 > 0, \m\ = 0, \n\ = 1 and 

m + 2>0 n + 3>0 



BOUNDEDNESS FROM H 1 TO L 1 OF RIESZ TRANSFORMS 29 

(9.1) mi + m 2 — 4 < — 2 and ni + n 2 — 6 < — 2 . 

We define k 1 = k°° X{(xi,x?,a)eG: a<i}- By (19.11) and Lemma l2~27 ii) . k 1 is integrable. 

We now consider the region {(xi,x 2 ,a) G B\ : a > 1}. There we may approximate e~ r 
by 1/(2 cosh r) and coshr by a (l + |a _1 (xi, x 2 ) | 2 ) . Estimating the errors, we can write the 
principal terms in the expression for k°° above as 

1 



ax m e- 2r + px n e~ 3r = a a H (aT^i)™ 1 (a -1 ^)' 



4a 2 (l + (a- 1 ^!,^)! 2 ) 



2 



where 



and 



+ ^ W (°"^"(°"^" J 8n 3 (1 + | ^ (xi , l2)| y 
+ g(x) 

= a~ 2 ?/;(a~ 1 (xi,X2)) + , 



^(^i, x 2 ) = a — — — - \7?\?+P- 



4(l + |(a; 1 ,x 2 )| 2 ) 2 "8(l + |(x l5 x 2 )| 2 ) 3 



g(x) = 0(a; m e- 3r + a; n e- 4r ) . 
By Lemma l2.2( i) and (19. ip . g is integrable in the region where a > 1, and ^(xi, x 2 )| < 

ca + Kx!,^)!)- 3 . 

Define /c 3 (xi,x 2 ,a) = a _2 ?/'(a~ 1 (xi, i 2 ))x{( :C i,x 2 ,a)eBj: a>i} and k 2 = k°° - k 3 . Then 

k 2 (xi,x 2 , a) = Q(x) + g(x) , 

and so k 2 is integrable, which proves (ii). 
Given a function / in L l , we obtain 

/ * k 3 (x 1 ,x 2 ,a) = 

POO p p 

= // f{x\- ab~ l yi,x 2 - ab~ 1 y 2 ,ab~ 1 )b~ 2 ^{b~ l y l ,b'~ l y 2 )d.y 1 dy 2 db/b 
Jo J Jr 2 

f(xi — azi,x 2 — az 2 , ah" 1 ) ift(zi, z 2 ) dz\ dz 2 db/b 

POO 

aT 2 ijj(a~ 1 vi, a^ 1 v 2 ) / /(xi — Vi, x 2 — v 2 , c) dc/cdvi dv 2 
Jo 

= [tpa *R2 h](Xi,X 2 ) , 

which proves (iii). □ 
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We remark that in |GS1[ Section 7], the analog of Lemma I9TT1 was proved for the operators 
i2L = XlXj(A r )~ 1 . We could also deduce Lemma [97T1 from that result. 

We shall need the following technical lemma, which shows how to construct functions in 
H\G) from functions in H^R 2 ). 

Lemma 9.2. For any function h in H 1 (R 2 ), there exists a function f in H 1 (G) such that 



H 1 (G) ^ II^Hff 1 ^ 2 ^ an d 



h(x u x 2 ) = [°° f(xi,x,,a)— 
Jo a 



Proof. Let h be in if 1 (M 2 ). Take a decomposition of h as J2j ^jbj, where Xj G C, J2j l-M < 00 
and bj are atoms in R 2 . The atom bj is supported in a square Qj of side Lj, and J bj = 
and || fey || oo < Lj 2 . We choose rj > such that either Tj < 1 and e 2 rj < Lj < e 8 rj or rj > 1 
and e 2rj < Lj < e 8 ^ . Define 

a j (x 1 ,x 2 ,a) = ^rj 1 x [e -r J e r ]] {a)b j {x 1 ,x 2 ) . 

The functions cij are atoms in G supported in the Calderon-Zygmund sets Rj = Qj x 
[e~ rj ,e rj ]. Now define / = ^ AjCij. It is easy to check that / is and has the required 

properties. □ 

We now concentrate on the part of the kernel which is not integrable, i.e., kh. 

Lemma 9.3. The operator />—>•/* kfj is not bounded from H 1 to L l . 

Proof. The proof will follow those of |GQS[ Lemmata 13, 14]. We will define a sequence of 
functions in the Hardy space H X (R?) such that ||^ a * h N ||i/||/jv ||j/i(M 2 ) is large. From 
Lemma [9T2l we then obtain a sequence of functions /jv in H X {G) such that ||/jv * fey 
is not uniformly bounded. 

Let be a C^-function in IR 2 supported in [—1,1] x [—1,1] such that J <fi — 0, and 
%p * K 2 0(0, 0) 7^ 0. Let L > 1 and let N be the greatest natural number with iV < logL. Let 
p, q be large natural numbers to be chosen later. Define 

N 

(9.2) h N = J2 £ ±( ^ fc ' 

n=0 fceZ 2 , |fej|<(2?«L-l)/p 

where the signs will be chosen later and <fi n k( x ii x 2) — <f)(2 qn Xi —pk±, 2 qn x 2 — pk 2 ). Let n and 
k be as in the double sum. Since supp0 C [—1, 1] x [—1, 1], we conclude 

supp nfe C [2-«*(ph - 1), + 1)] x \2- n \pk 2 - 1), 2~ nq {pk 2 + 1)] . 
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It follows that tiN is supported in [— L, L] x [— L, Li\. 

Claim 1. One can choose p, q and t > independently of N so that for all sign choices 
in (JH2D 

p({(x 1 ,x 2 , a) : |^ a * h N (x 1 ,x 2 )\ > t}) > C N L 2 . 
Claim 2. The signs in (19. 2\i can be chosen so that ||^at||2 < C L. 

Proof of Claim 1. Since ip *r2 0(0,0) ^ 0, there exists a positive 6 such that \ip a *r2 
4>(xi,x 2 )\ > 5 for (xi,X2,a) in a neighbourhood U of (0,0, 1) in M 2 x M + = C We can take 
U contained in [-1, 1] x [-1, 1] x [1/2,2]. It follows that 

(9.3) \ip a * R 2 (f) nk (x 1 ,x 2 ) | > 5 if (xi, x 2 , a) G U nk , 

where U nk = {(xi,x 2 ,a) : {2 qn xi — pki,2 qn x 2 — pk 2 ,2 qn a) G U}. The sets U nk are mutually 
disjoint and p{U nk ) = 2~ 2qn p(U). 

Now fix < m < N, I G Z 2 such that %\ < {2 qm L - l)/p and take (x u x 2 , a) G U m£ . By 
(19. 3p . in the sum 

N 

n=0 fceZ 2 , \ki\<(2« n L-l)/p 

the term with n = m, k = i is greater than S in absolute value. The other terms are much 
smaller; more precisely, we can choose p, q such that 

(9.4) ^ * Mx!, x 2 ) \<5/2. 

The proof of (19 .4p is the same as |GQS Proof of Claim 1, page 277], and we omit it. 
This means that 

N 

{(x 1 ,x 2 ,a): \ip a *h N (x 1 ,x 2 ,a)\ > 5/2} D |J (J U nk . 

n=0 k&Z 2 ,\ki\<(2i n L-l)/p 

Thus, choosing t = 6/2, 

N 

p({(xi,x 2 ,a) : \ip a *h N (x 1 ,x 2 ,a)\ > t}) > } u ^ p(U nk ) 

n=0 fceZ 2 , \k t \<(2i"L-l)/p 
N 

> Cp{U) ^V 2<?n (2 gn L- l) 2 



> CNL 



n=0 

2 
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Proof of Claim 2. This proof follows the idea of GQSJ Proof of Claim 2, page 279]. On 



the set of all sign choices in (19.21) . consider the probability measure which makes the signs 
into independent Bernoulli variables. Denote by E the corresponding expectation. Then 

E\h N \ 2 { X ) = J2\<Pnk{x)\ 2 

n,k 
N 

= E E |0(2^x 1 -pA; 1 ,2^x 2 -^ 2 )| 2 . 

n=0 fceZ 2 , \ki\<(2i"L~l)/p 

Since <f) nk is supported in [(phi - l)2~ nq , {ph + l)2~ n «] x [(pk 2 - l)2- nq , {pk 2 + 1)2-""] and 
uniformly bounded, we get 



J E|/ijv(xi, x 2 )| 2 dxi dx2 



N 

< C J2 E I Kp*! - + 1 ) 2 " t9 ] x 

n=0 fceZ 2 , |fc i |<(29«L-l)/p 



x [(pfc - 1)2-^, (pfc 2 + 1)2- 



run 



N 

<cY, E 2 ~ 2n9 

n=0 fceZ 2 , |fe i |<(28«i-l)/p 

< CiVL 2 . 



Thus E||/ijv|| 2 < CVNL, and Claim 2 follows. 

If we choose p, q and the signs in (19. 2p as in Claim 1 and 2, the function will be a multiple 
of a (1, 2)-atom in M 2 (see |CW] ). Indeed, it is supported in [-L, L] x [-L, L], with integral 
zero, and ||^jv|| 2 < C y/~N L. In particular, Hn is in if 1 (R 2 ) and II/iatIIh^r 2 ) <CL 2 y/~N. 

By Lemma [9T2l there exists fa in if 1 (G) such that ||/at||_h"1(g) < C L 2 \/jV and 

Jo « 

Thus by Lemma 19.11 and Claim 1 , 



\\f N * k ||i = / / |-0a * /iAf(xi,x 2 ,a)| d/)(a;i,x 2 ,a) 
Jo ./r 2 

> tp({(xi,x 2 ,a) : |Va * h N (x 1 ,x 2 ,a)\ > t}) 

> CNL 2 . 

This shows that ||/jv * ^fjlli/ll/jvll^CG) is n °t uniformly bounded, proving the lemma. □ 
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Theorem 9.4. The operators , for i = 0, 1, 2, are not bounded from H 1 to L 1 . 

Proof. This is a direct consequence of Lemmata 19.11 and 19.31 □ 
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